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ABSTRACT 



The impact of programed instruction on the 
educational system has been minimal quantitatively and qualitatively. 
In the interface between education and programing there are serious 
weaknesses in the design of materials, severe problems in the 
economics of design and use, and an almost insurmountable gulf 
between the philosophy or point of view on which programing is based 
and the present thinking of most school systems,. Two areas in which 
the technology needs further development are in the analysis of the 
structure of knowledge and in the approach to cross-curricular skills 
such as creativity, critical thinking, and inference techniques. The 
unnecessary duplication of effort which is common in programing 
instruction today has led to a waste of financial and human 
resources. There seems to be a philosophical conflict between the 
empirical approach of the adherents of programed instruction and the 
idealism of the process-oriented educational philosophers,; (Author/JY) 
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The programing of instruction is a process of designing 
instructional materials and systems which results, if followed 
to its full extent, in a rationally constructed and empirically 
validated product or set of procedures. The process consists 
of five basic steps: 




1. Determining the objectives of instruction in order to, 

a) describe an observable perfomance of a student who has 
completed the>.. instruct ion, b)make clear the conditions under 
which students will demonstrate mastery of the material and 
c) establish a standard of acceptable performance. 

2, Designing and evaluating the "criterion measures" \diich 
would rate students individually on a scale of attain- 
ment of the desired knowledge or behavior. 



o 




3. Testing potential student groups to learn their charac- 
teristics idiich will determine, in turn, the design 
of the lesson.. 



4. Selecting instructional media and preparing instructional 
material in draft form. 



* Susan Meyer Markle is Head of Programed Instruction, Office of 
Instructional Resources, University of Illinois at Chicago Circle. 
This paper was prepared as an addendum to a chapter submitted to 
the Macmillan Company for publication in The Encyclopedia of 
Education in 1971. 
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5. Refining the product through try-outs with individual 

students until effectiveness reaches satisfactory levels. 
This process is then continued with increasingly large 
groups of students until effectiveness proves satisfactory 
in approximately "real" situations. The materials are 
finally "validated" by publication of a complete descrip- 
tion of their performance in terms of their effect on 
specified groups of students under carefully described 
conditions. 

Programed materials, therefore, cannot be identified by any 
single format. The only observable distinguishing characteristic 
is a product description, providing the consumer with the complete 
set of objectives, matching criterion measures, and data, drawn 
from research with students, which support the claims for the 
teaching effectiveness of the materials. 

The impact of programed instruction on the educational system 
has been minimal quantitatively and qualitatively, "Software" is 
one very important problem: when considered in relation to their 

proposed intent to truly individualize instruction, the quantity 
of programed materials available to the schools is still miniscule. 
On the other hand, schools generally do not require effective 
products and methods because administrative innovation has not 
proceeded at the same rate as instructional innovation. 
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In sura, prograraed instruction is not fully ready for the 
schools and the schools are even less ready for programed instruc- 
tion, In the interface between education and programing there are 
serious weaknesses in the designing of the materials, severe 
problems in the economics of design and use, and an almost insur- 
mountable gulf between the philosophy or point of view on which ' 
programing is based and the present thinking of most school systems, 

■ ' ~ ^ ■« 

miehhnrjssns in tho boohnoloov , A significant problom in the dosign stage is 

the selection of appropriate objactivos. In industry and in military organizations, 
tuhers programing has had considerablo success, thare exists an ultimate 
rcforoncs against which ths appropriateness of the objectives can bo tested, 
namely the Job for which tha man is being trained. This is not to say that 
such Job descriptions are necessarily simpla, especially vjhon interpersonal 
relations are involved, such as with salesman or managomsnt trainses, Hovisvsr, 
where such a Job exists as a reference against which instructional decisions 
may be validated, lean programing makes obvious sanse. One can determins 
standards, which may include efficiency as well as effectivonsss (see D, 

Marklo» 1967b), and build instruction from this endpoint backwards. In tho 
educational sotting, with no such outsida reference, tho instructional 
designar is usually thrown back upon tho more or less illogical content 
covorags found in existing texts and syllabi. With a few possible exceptions 
in soms of tho curriculum projects now undsrway, this content coveraga is an 
Irrational patchwork of topics bearing little relation to what students have 
already learned or to what they will need to know in future courses, Tho 
fractionation and lack of articulation between and within subject matters 
has boon noted many times; tho problems created are sarlous for teachers and 



instructional materials dsvolopars vyho havo to "cover" matorial. For programars, 
oriented to student performanco, ths problems are critical. Buried in the* 
patchwork are two areas where ths technology is not yet mature, 

Ths first area vjo might call the "structure of knowledge", in the sense 
intended by Bruner (i960) and others. It hardly needs saying that we have no 
firm grasp of vjhat happens to students whsn various elements in the mathematics 
or science or social science curricula are moved up or moved down in the acadsmic 
progression. For..: instance, on a speculative note, if sot theory is taught in 
the first grade, would this not in some way affect the ability to form logical 
categories — which 6s included in ths "process approach" to science several 

I • . * 

grades later? Or might it not interfere with the child’s ability to grasp ths 
essentially illogical categories of traditional grammar y;hen he meets them in 
seventh grade? No research designs exist at present for expanding the 
measuring procedures used in validating programed materials to take account 
of those possible transfer effects. No pressure exists to do so, of course, 
since ths teaching profession doss not itself do so. What I see needed here is 
some long-term development studios paralleling some of the pioneer work done 
in individual language development, where individual children are intensively 
followed over long periods. Such an approach is implicit in ths orientation of 
operant conditionsrs who tend to study single organisms intensively for long 
periods of time. It does not gonsrally exist in educational research, vjhere a 
developmental study is more likely to Include a sampling at one point in 
time of different individuals at different ages, (The ujork of Piaget and 
Gesell illustrate this latter approach; Terman’s studies of the gifted is 
a rare example of the former,) 

Programers have begun work on the types of analytical procedures needed to 
Improve objectives. There are, however, no published papers or results as 
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yet from the work of persons like Philip Tiemann and myself, Richard Anderson ^ 
at the University of Illinois, Urbana, or James Popham and Eva Baker at the 

i • 

University of California, Los Angoles* Similar in intent, but not fully 

adequate to this purpose, is Gagne *s analysis (1965), The absolute noccss5.ty 

of new techniques of analysing knowledge has become apparent from the 

weaknesses in the kinds of objectives which predominate in available 

educational programs. In othsr words, thero must be a way to attack rationally 

the question of what ought to bo taught. But the technology for deriving 

better objectives does not yet exist in educational subjects to the same 

extent as In task analysis for industrial objectives, 

A eocond and related area in which tho technology noods further development 

Is in the analysis of what might be called "cross-curricular skills”, among 

which would bo "critical thinking", "inference techniques", "creativity", 

and others, Skinner (1968) points out that tho attem^)t to toach thinking, 

in the sense intended by proponents of discovery learning, often leads to 

inefficient teaching of the subject matter boing "discovered", Tha conflict 

is real, in that students undoubtedly should be led to think for themselves and 

yet ths method of discovery often leaves them with precious little knowledgo 

to think about, A few direct attacks on the problems of teaching thinking 

or creativity (James Holland's program on inference, Richard Crutchfield's 

program on critical thinking, end Sidney Parnes' work on creative analysis) 

have had little effect on the design of programs aimed at subject-matter 

knowledge, Ths technology of empirical testing — the revision cycle based 

on studont errors — almost guarantees dropping any frames and sequences 

which require much thinking skill, since the error rate genorally goes up. 

As a consequence, remarkably little is known about hoyj to produce such 

0 

skills reliably. 



Ths computer as a magnificent branching tool comss to mind in discussions 
of teaching thi.nking. The prognosis for computer assistance with this problem 
would be moro hopeful, however, if we had a better software technology for 
producing thinkers# Most of tho ‘’dialogue” mode software now used as illustration 
of what computers will be able to do in teaching thinking are really nothing 
more than tests of skills already learned. 

The technology of analysis is incomplate in thesa two areas. Until these 
puzzles can bo solved, the products of the programing process will not coma 
up to the fond hopes of tho educators. It is, of course, readily apparent 

I 

that present educational techniques are not achieving such results either, 
although educational goals promulgated by school systems would lead us to 
think they are. The avarags educator, unconcerned by the gap between the 
goals claimed and any evidence that students are achieving such goals, 
tends to reject as beneath consideration products which, if appropriately 
administered, can reliably achieve the lesser objectives claimed for them. 

Economic problems . There have bosn many references in the literature to the 
remarkable amount, of development tima invested by programers in producing 
reliable products. Estimates of 50 to 75 hours per hour of student time are 
frequent, even for the so-called "simple” skills of military and industrial 
training. The economic advantages of such an extensive investment of programer 
time have been calculated in an industrial setting where students are paid 
while learning and production losses due to ineffective instruction can be 
at loast estimated, (K, Brethowor, 1966, See also, Rummler et al,, 1967,) No 
such econdimic basis for improving instruction has been agreed upon for 
education, 

« 

A short perusal of a bibliography such as Kandershot’s (1967) reveals 
that, most- programs, including those with a sound research basis, are being 
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sold to schools at prices competitive v;ith traditional textbooks. Some 

programs oimeri at the industrial^market appear to have more meaningful 

* • 

price-tags. Given the small distribution of any programed material whatever 
In the schools at present, as msntionod in the article, and.ths small per 
unit price, it is indeed small wonder that so few fully researched effective 
products havo appeared on the market® 

i 

The financing of the capital development required is still problematical, 
Fractionatod school districts certainly cannot afford it, nor do they generally 
have either the talent or technical knowledge to produce such materials, 
PubHshers, accustomed to reimbursing authors by royalties basod on sales, are 
wary of the immense investment required by the research. Authors do not recover 
their investment of time (1 have calculated a returned vjage of 50 cents per 
hour on one of mine) and the ' financial woes of the programing companies which 
concentrated solely on the school market is well-known. 

Considerable discussion of government priming of the pump has taken place 
(see Subcommittee on Economic Progress); at least one of the regional laboratories 
backed by the Office of Education is officially in the business (see Popham, 

1967), There is, of course, also the risk capital available in the "education 
Industry", the effects of which at the moment are unknown, fOuch has been said 
about the concentration of that industry on glamorous hardware; it is well 
known that software, if available at all for these new machines, is rarely a 
product of behavioral technology at a level of sophistication consonant with 
the hardware. 

As one wit said "If education had produced the Edsel, thay still vjouldn't 
know it was a failure*" It is difficult to see how appropriate pricing of 
effective products backed by expensive and extensive research can be fostered 

o 

when the consumer Is apjDarently Incapable of making the appropriate discrimi- 
nations. 




Economist Donold Paden (1967) has thsorizod that, at Iscst at tha coIIoqo 

IqvgI, a ssv/oro problem exists in providing the resources to enable instructors’ 

to take sdvantagD of the new technology. A professor who is caught up in the 

cycle of frequent lectures, last-minute construction of tests, and manggsrnsnt 

of increasing numbers of students has, in the publish-and-perish world, little 

time and loss incentive to invest ths required effort in instructional improvs- 

went. Ho talks of the notion of "critical mass" — of davoloplng enough 

replicable (though not programed) instruction via film, TV, tapes or whatever, 

60 that a course may be, in a sense, self-opprating or run by assistants,- 

When, for instance, a sufficient number of lectures are on videotape, the 

instructor is then freed to devote time to improving them, making do with 

.less than perfect performances in most lectures while he upgrades ons at 

a time. To do so, the instructor nedds not only the time released by his 

previous investment of time but also considerable tochnical help in the 

production process, Paden has also emphasized the impossibility of the 

educational system repeating this experiment on every campus in every uni- 
» • 
versity, because of the cost. 

Such an investment of capital resources and talent suggests that the 
resulting improved products should command wide distribution. In reality, 
university instructors tend to give little consideration to using other 
instructors' validated lectures, though they feel no qualms about adopting 
texts. The widely used phrase "not invented here" (ths NIH syndrome) puts tha 
finger on the probably causs — the ego satisfaction of the instructor in 
his role as purveyor cP information and his unfamiiiarity with tha role of 
manager of learning. This phenomenon is parallel to the still-prevalent fear 
of teachers at* lower levels of the educational system that programed instruction 
will somehow replace them. The economic loss represented by the cottage-industry 
approach to instruction — every professor across the country writing the same 

m 9 * 

formula on the blackboard for thirty students in front of him — has tha 
parallel in what I call the "prima donna" approach to course development, in 



tuhich osithsr administrstor no^ dapartmsnt hsad nor even colleagues teaching 

later courses viould presume to tell a professor u/hat his course should achieve. 

The “critical mass" phenomenon was obliquely mentioned on p, 17 of the 
article. The significant capital investments in education lie in buildings and 
wages for the staff, not in teaching materials. Whsn the number of students 

Increases in such a system, the system adds new classrooms and new staff. Little 

thought is given to incrasing the efficiency of the system's us« of its 
resources. Efficiency cannot be calculated with any meaningful accuracy, 
however, until effectiveness is established, and this basis is still lacking. 
Until a sufficient number of products exist to enable a shift to a criterion- 
referenced system, there is little incentive for educational systems to endure 
the pains and problems of operating partially on tims-accounting and partially 
on effectiveness-accounting. Until there is a discriminating market for fully 
researched materials, it is unlikely that many will be developed. The result 
is a stand-off between these two realities. It seems, in concurrence with the 
findings of the Harvard University Program on Technology and Society (1967) 
that, barring some revolutionary development, especially in the administrative 
area, substantial and sophisticated use of educational technology is not likely 
to occur in the near future. 

i 

Philosophical issues . It is not clear at the moment how many of the arguments 
bandied about are a function of a true difference of opinion and how many are 
purely a function of the preferred language of each side. The use of the term 
"technology", the emphasis of operant conditioners on "behavior" and especially 
upon "control" have undoubtedly created violent reactions where the intent and 
even the methods would bo fully acceptable to the opposition. Any attempt to 
"improve" instruction is, of course, implicitly an attack upon its present 
state and is so interpreted by its practitioners. 
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There does, however, seem to be a basic divergence in point-of«view 
between the tough-minded empiricism of the product-oriented programing 
fraternity and the tender-minded idealism irrespectiva-of-avidence of the 
process-oriented educational philosophers, Skinner (1968, p90) points out 
again, as he has before: "We fear effective teaching, as vjb fear all effective 
means of changing human behavior," Tha technology of instruction, based on 
a scientific and experimentalist approach to human behavior, vjill probably , 
remain in conflict with other positions for quite some time. It remains to 
be seen whether its existence vjill, as Mssthene suggests technology can (i960), 
determine a change in the value system and administrative organization of 
the school system or whether the "educational establishment in the United 
States /is so/ ideally designed to resist change " (Harvard Program, 1967) 
that the technology itself will be kopt outside the doors. 
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